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. REPORT SUMMARY ~~ 


“Focus for the 1974-75 Evaluation Project 


This document reports on the 1974-75 USMES evaluation investigating 
the cognitive and affective responses of USMES students-to this interdis- 


ciplinary, process curriculum. It includes the results of a pre-post con- 
trol group design to assess the curriculum's effects .on students’ basic. 

a : ‘X 

skill development, their attitude change, and their progress in complex 


problem solving. The results of interviews with USMES teachers and stu- 


dents, unstructured observations at field sites, and the field staffs' docu- 
mentation of USMES usage are also included, A second report will document 


y 


work on the development of new Eechniques for assessing student prcgress in 
complex problem solving. 

a a “The original proposal to the National Science Foundation for the con-— Pe 
tinued evaluation of USMES during 1974-75 was broader in scope ‘than the Stan 2 
which was funded. As amended, the 1974-75 SMES Evaluation focused on stu- 

® dent effects of the program: . their abilities in problem sctyingy thele basic 
ahead dey elopeenrt their attitudes toward maths science, problem solvings and 


toward wabioue: learning activities embodied ony the USMES phi .osophy. “Tea= : 


cher training, .support networks for UGHES users, iscnatdive program monitor- 


Ss Ra aE 
ing, material resource usage, and program dissemination patterns were deleted 
sae - ; ' ae “ 
5 as areas for investigation. ; Clearly, the Foundation's overriding concern for 
. : en Org mex 
es : 5 . e t a ‘ - < 
; , an evaluation of USMES was the pursuit of. an investigation of its "proof of 


concept," ise. the examination of the students' problem solving abilities and 


basic skills “as they develop ‘under the influence of the USMES program. ° 


= oe aS os 
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Sample Selection, Data Collection, and Method of Analysis / 
: 4 gettin 


“Purposivessampling of new“and experienced USMES teachers from 15 geo- 
graphic areas was used to’ achieve a sample of USMES classes representing a 
cross section of grade levels, socio-economic levels,-and unit challenges. 


Control. classes came from non-USMES schools which were located in the same 


” 


or neighboring communities as the USMES schools. These control classes were 


. 


selected to match the USMES sample”classes, one-for-one, on the bases of grade 


level, socioeconomic .level, geographic area, and general features of the 
o: ‘+ 
schools? Drogtan, A . ie. 


Responsible) field staff eae were trained to serve as on-site eval- : 


ry 


uators for the test saninitekcueiee and for the obawevaedon of class activities 


in these USMES and control sample classes. Interviews were completed by the / 


& evaluators with all 40. USMES teachers and 120 students’ in the evaluation sam 


a 


ple. However, the maximum sample size achieved for other areas of the data 


r 


collection was 37 USMES classes and 34 control classes. 
The sample attrition from the proposed comp lenient of “40 ‘USMES and 40 con- 
* trol teachers can ve attfibuted to problems with two observers who did not 
meet ibake commitments to data collection, and to’ the very siringdk: veqaiees 3 
ments:of one state's law for permissions for nant testing. 
hes at ‘ “Several indicators in addition to the interview technique were add, te > 2 
aeauies data.on the préerants effects on student performance. The pre-test, 
3 i : 
.post-test- control group design governed data collection on students! basic 
skill saad ommend, Hine poeneeasave in’ ‘ptobl.ém solving: and altanges in their, 
attitudes board atthe. science, problem solving and varios learning activin» 


. 


7 “ries. Six subtests fromthe Stanford Achievement “Test babtary: were selected 


to measure basic skills.. Krohlea solving ability was assessed with the Picnic. = = __. 
/. : . . : ¢ 


‘developed to investigate attitude change. 


. ‘a : . 


Problem and the Playground Problem--two tests of small group performance in 
simulated, real-life problem situations. A Likert-type attitude scale was 


9 


The student performance data were submitted to two-factér repeatud 
‘ 


measures analyses of variance to determine if the treatment groups at’ each 


grate level pad realized statistically significant gains from pre-test to 


‘poe ceed Mdudnkezea tin on ‘any of the measures of performance. "Whenever the 


< 


-data warranted and assumptions’ could, be met, covariance analyses were also 


© 


used to test the hypotheses that there were no significant differences be-. 


tween the treatment groups! adjusted post-test performances. _ 


*: ‘ 


‘Characteristics of Experimental and Control Classes 
‘- 5 ‘ ry “9! ¢ 


One essential component of this evaluation is a description of what the 


” USMES experimental program is like in:practice, and how it differs;from. the 
; : pe 8 4 . ae F 


t treatment. being app}ied to. the comparative control groups. This documentation 


of 


eat / 
was necessary to make meaningful comparisons between the performance scores 


. 4 . 
of students in the experimental program and ‘the measures for students who d‘i 


° 


not receive the innovative curriculum. rs 
. € ‘" 5 


USMES classes in the sample received diverse applications of the ‘USMES 
} . 


program. Some USMES. classes experienced brief applications of the program 
throughout the entite school year, while others had their USMES time concen- 
- . ' . i ; 
trated in intensive periods over a few weeks onlys Many combinations of . 
aoa : es z ae A : 


F a 4 “ ¢ 
levets of intensity and duration of uSage were reported by the. sample USMES 


" teachers, but, on the, average, classes spent 1% hours.a day, three days: each 


weeks, for a2 weeks on an USMES unit.:+ Most .classes worked on only one unit 
“devine the | years ‘ ~ 


, 
/ 


For most USHES chasses,. ‘the bina for USMES came > petuaeity form science 


- 


time. the » statistically everaae USHES class" reportedly borrowed some 


. a : ; 
5 - . 
; ‘ Ls e 
: in : te 


ie ae 


ese 


additional time for USMES other subjgcts, most notably from social studiés 


and language arts. Precise data on how teachers fit USMES into their over- 


all programs could not be obtained without continual monitoring of ISMES 


“ classes during the USMES and non-USMES portions‘of their curricula, before 


or after and during periods of USMES use. 
The distribution of average time reportedly spent on non-USMES school * 


i ; 
subjects and-activities.for USMES classes when they did not. pursue USMES was 
oe ° % 


-very Similac to the distribution of average times reported for control 


classes. The measures of variability in these times for each subject or 


activity were very large in both the,USMES group ‘and the control group. 


Similarly, both USMES and control groups represented tremendously vari- 
able patearha inthe kinds of non-USMES curriculum materials and programs 
they used. There was as much variability within treatment groups as there 
was between treatment groups, except for the fact that no 1974-75 sample 


control classes were ueaty or had used USMES. 


a 


Despite this‘ variety in the nature and intensity of the treatments which 


the groups sine 3 the. pewelts from the 1974-75 Class Activity Analysis in- 


dicated that hie were eleaely distinguishable differences observed in the ; 


"winds of aehivitied puveaed® by USMES versus control students. Teachers con- 


° 


tinued to doniinate class aetivity 16% to 20% of the time- in both treatment 


groups. _However, during the remaining observed class time, USMES seddiees 


Vis 


. oe: a ‘ . 
exhibfted a wider repertoire of behaviors, and they spent larger amounts of 


time in more active, self-directed,‘ ‘and creative behavior than the Control 


‘ 7? v 


“students. When the control s.udents were not ‘focusing on their teachers, 


: they ware apending ‘much of the balance of ‘the observed class time in very 


structured activities--prestructured derlbag: Wieesbaeteend wine: eal. 


. -9 


e 


calculating--probably on worksheets or in workbooks for mathematics ‘and/or 
“ ? 4 


eo science. é < ‘ 


~ r - 


o% : 3 & 
Interview Results: Teachers, Students, Administrators 


The interview was retained as a data collection strategy for the con- 


tinued evaluation of, USMES during 1974-75 because of. the valuable insights 


sgained from the previous year's interview results. A sample of 40 USMES tea- 


4 
° : 
*. chers was selected to be interviewed by the two senior members of the evalu- 


ation team during the first three. months of 1975. 


. 
> 


« For each USMES teacher interviewed three of his/her students were also 


« 


interviewed. In addition, the evaluation staff members spokg: infgr..ally with 
‘the administrators in the schools of both the USMES and control teachers. « - 
pee : : 


The interviews focused on the effects of, USMES or student and teacher be- 


/ Ps 
‘havior. Other issues arose in the course of the interviews with teachers 


and administrators, but these were dfscussed in a separate ‘section of the ¥ 
report, since they ‘do not relate directly to the questions “in the interview 


schedules. 


se 
~~ -o 


Most of the points in the chapter on thé interview data came from pairs 


of sourcest’ teachers and students; teachers and administrators. This built- 
3 / . é * % af > 


in system of checks, helped to eStablish ‘the validity of the informations 
Another source of information,’ the observers at each site, served as an ad-- . 
‘ : dx é — 


ditional check-point. : : oY 


* There was no disagreement on the subject of children's enjoyment of USMES. 


“The children did enjoy USMES and they looked forward to using it. All agreed 


° 


that each child derived something from the program: increased knowledge in “ae 


od 


content areas, or ability to solve problems, or socialization-skills, or 


~ ae ee ros 


/ 7 : ¥ q . 
a 


“ek increased feeling of self-worth, or a confirmation of. ali three. What each 
e ; . \ « 

child derived’ from USMES appeared to be .a function of the teacher, the ~ : ‘6 
i. z - So) alt o s oa 

” { "challenge," and the child. s . 2 : 


The philosophy of. USMES received complete support from teachers and ad- 


ra ministratorse There was not.a single instance of anyone in either group 
é 


. - > 
s:/ questioning the value of a’ problem-solving approach in’education. Since 
. ’ 


these largely self-selected USMES users favored a real problem-solving ap- 


3 proach, it follows that’ they'also favoréd an integrated ‘approach to teaching 
Pa? 2g the disciplines, in order to solve the problems. And in theory, they did. 
; x ‘ 


In practice, there-were difficulties... Departmentalized programs, rigid time 


schedules, and most teachers’ Limited content background (especially science) 


a 


4 5 bees! 


.% o 


made the integrated approgch difficult. 


eee eee ee 
en ° 


~-t -"" "". """ “the nature of the USMES challenge was another: factor ‘which made the prob-  ~/ 
lém-solving approach and the integration of the disciplines difficult to im- | 


’ plement. Some challenges simply did not lend themselves to a problem solving: 


ax 
“approach. Very often, the challenge was not perceived as a problem by the . 


children,who Simply saw what they did as a series of unrelated activities. 


— In some instances, even the teacher did not perceive the USMFS unit as a - 


a ’ 


problem. ey & 


a 
Administrators and teachers supported this perception by asking whether 


USMES. was teaching problem solving or-was just a series of activities, often 


Mare 


seen as "gimmicks." For those students and teachers who saw a challenge as 
‘ “ s . 


eo - . 
a problem, theré was some feeling that the method of solution was general- 


Lt is izing to other areas. © ee 


While USMES -appeared to be teaching new skills, it was seen mainly -as 


reinforcing old learning. ‘Teachers and students had no difficulty identifying . 
/ 3 


“the specific aspects of mathematics being learned, but neither students nor 


ar # : ‘ Rae ae . 


+ , teachers could. identify very much science involved in the program. Other , ae 


" content areas, e.gs, language arts, social science, were identified by some 


teachers as being heavily involved in the program. 3 4 : oO eho ot 2] 
- e ’ : . s : * ; . ag r aa 
are os Although the. content emphasis was a function of the particular challenge, 
it was also a function of a specific teacher's likes and dislikes. Teachers ° 
as $ : ee : af 


“still tended to stress those areas which interested them or which they felt 
3 4S. its ° : * _3 2, es = 


5 og ae if ; ig 
? most comfortable teaching. ,And so, they tended also to choose those challenges | _ & 


* with which they felt most comfortables ae a, result, those sunits which empha- : é 


sized the ‘Dietat science contexts of mathematical applitations were most’: “often 


et y used. ; eer” a. 
yo is. ; 
Teachers continued ‘toslearn to use the program through workshops or ‘by. Oi 


word- of-mouth, rather. than by ueing the manual. Other materials’ developed | 


ay 2 


specifically for USMES, CoBey how-to-cards and ‘technical papers, were alsom 


getting minimal sage, — both by. arydents and teachers. Even the Design Lab 


we Py ~ “Sas 
° ‘ 


usag declined noticeably from the previous year. °° . . ; , , ; : ' 


ieee 


Aui- in-all, however, the interviews revealed that’ USMES appeared 


Ps be 2° 
fulfilling some of its promises. ’ There. were indications that children felt © ~ | 


, . 


capable of dealing with éhete guvlromest, and that beachend) through less 


directive BemETC ME were. encouraging children | to solve thes" own problems. 


USMES send to be changing the behavior ‘of both.teachers oe students, in 


' = es 4 2 


; what the developers could view'as 4 nodietva aide Ob std 

: “es . F E : i ne 
Me : aye 
Basic Skill Peveloowent a 


- 


Development sis problem solving abilitis nd Sasi skill development are 


° 


. seen as tye interdependent. tasks. for the USMES program. “To fully evaluate a 


a 


* 


the fvesi, an examination of the second must also. be made. mS i: ‘ 


q- . _ : st % 


“10. 


rn e e ‘ J a’ Ry t hy, 
e . 
es . “ - 4g oe 
. @ . s aa’ “ 
é : es me : 
. ! » ta - ” 4 a 
.: v rae . . i esd *y : 
: ‘ Nw * ° 
ae lg . ' 
‘i 7 ‘ Zot ie ‘ a) ad . = 
. A Pre-test, post-test sonkxol group ventBN was used to investigate 
} 5 . : 


wherhex USMES students maintain the seieleve! of basic abit Seve vopment 


as control. students} even: though ‘sigs Sang may detract “trom. the amount of 
, 


mn > 


basic skills instruction which, USMES students ‘can receive. Basic skill 


development was ‘ memeused with Fall and spring administrations of selected 


‘ subbests. of the Stanford Achievement Test Baptetys: (a) Reading Comprehen- 


ait “ee (b) Mathematics Computation, (c) Mathematics Application, (d) Mathe- 


es ee er ° 


‘ in matics Concepts, (8) Betence, and (£) Social, Science. 


- os . 


. 
ow a a = ot ‘ 


“Several beoblems were ‘encountered in the collection, ‘analysis ‘and inter- 


a” . » a 


pietabdon of the SAT’ dike However, none of these ‘problems prevented an un- 


oie * equivocal response to the expressions of concern about accountability for 


the’ Communication ae basic skills. Gheaely USMES students do not. fall hae “ p: 


hind. their control counterparts in their performay ce on tests of basic ski ys. 
On all six post-test mbaskess the shies USMES meamwas higher than. the over- 


vs . 


- ‘all control ida hae the differences were not statistically significant. 


The USES program peeporys ‘to enhance thé“problem solving a ar of 


aces "Bs ‘elementary school students without impairing their’ vate skill ie topeents? 
AOE TE See Indeed, the results of our “analyses” of basic skills data suggest that fears . 


about Nee of basic skills of USMES. students are uavarranted. The. 


. Tee Ae 


“question which may merit “further investigation “is. ‘not whether USMES detracts : : ~ 
f'rom basic skill seve Lopment," but aati ones seek basic skill dusts 
opment, especially for ‘eeudenks: in the higher grades of Bi aces ‘school. : 
- ee 78 Py The largest . increases in neeie je shel, development were observed betwen : 

6 the ewe grade blocks. Of course, this oes of ‘development ‘refelets j : y 
sie a the growth curve found for many areas of intellectual and physical sieve s 


» ment. While not statistically significant, there was a noteworthy trend 


-9- 


Le ec 


. ’ 4 2 a , a 
for the growth rates of the control classes to fall behind those for the 


USMES classes',at the upper grade levels. 


Both USMES groups and control .groups experiettced similar rates of devel- 


4 


opment in the basic skills in the early and middle elementary grades. Fur- 
A 


. 


thermore, both these control and USHES, clases were generally close in aver- 
age scores at pre-test time and at post-test time. However, the pattern 
- changed: for USMES and control groups in the higher elementary grades. 


While the USMES group exhibited continued growth in each of the six sub- 


. 


> * test areas, the control group ae less growth or even showed a decline 


in performance. 
aX P 


a 4 


This observation may be inateliise of the effect of the USMES pro- 
gram on Racks skill development at che ‘hight elementary grade levels, 
» but it may also be a: function of sampling bias. Control classes were matched 
_7 with USMES sample -classes on the basis of gradg level, socioeconomic compo- 


sition and type of school program (traditional, "open," '"non-graded," etc.), 


and’ the pairs of USMES and control classes came from neighboring school se, 


. 


pret ar, ’ oe 
Nevertheless, careful matching on the most salient criteria is,no assurance 
-of comparability of treatment groups on all, relevant factors other than the- 
ae a ry 
treatment. : ‘ a # 
~ > . 


: . ae ( 
_ Another point was raised in the discussion of basic skill development 


« 


of USMES versus control students. It was a point of information which the 


evaluators uncovered during their interviéws with USMES teachers. They found 
\ Sf ue + 


~ 


‘ 


‘ ft, ; ; <2 : * 
that USMES stadents “have not been deprived of instruction in the basic skills. 
" ‘In some cases, they may have been getting more than the non-USMES students. 
he USMES classes we interviewed, mathematics con- 


\ 
. tinues to be taught as a Separate content area. These students were getting 


_ 


Without excéption, in all-t 


. 


-10- 


their ordinary math instruction plus "USMES math." One might hypothesize, 


therefore, that USMES Students should exceed the control group in mathe- 


id / 
, matics performance. ‘te 


e As'for science, in the majority of cases, USMES was the science pro- 
e ry —_— x hare 


gram, for a portion of the school year, or for the entire school year, and 


one wonders if there would be any science if lone Seek presented. There- 
fore, in the math and science skills areas, USMES should not be interferring 
a with basic skill development, but rather, adding to it. 


. "In other skill areas, i.e. reading, language arts, and social science, 


“. pe 


_our-other sources of data support the conclusion that USMES is not taking 


much time from these.areas.,: Some of the claSses are not self-contained, and 


So ad aba “ : . 
for these classes, schedules and-.amounts of time*are mandated for basic skills 


ee 


iustructions ” : ae : . P 
x Te Clearly, USMES uSage, as practiced by sample classes representing-a wide 
distribution of geographic areas and socioeconomic levels, did not affect 


‘. wr basic skill development adversely. Previous investigations on this issue 


. F iva 


yielded similar results. ‘The measurement of basic skills has been a costly 
_ and time consuming activity and sample teachers, principals, and their stu- 


dents have become increasingly resentful that this kind of test ddministra~ 


7 8 


tion is disruptive of the school day, and sometimes is threatening to students. 
“The evaluators recommend that hie tedeuneen devoted to comparing the 

basic skill deve lopment of USMES ang control students should’not be expended 

in the Futures denen, the issue of ,basic skill development should be of 


4 
diminished importance in light o£ the patterns of USMES usage in most schools. 


r e ‘ 


Most frequently, the time for USMES comes from regularly scheduled science 


time, andto a lesser extent from project time. Hence, one should not expect 
' F] 


« 


— x . i 13 | a? 


Ji 


USMES children to fall behind in the basic skills areas of reading, language 


arts, and mathematics which are of primary concern to most clomentary school’ ~~? 


- . 7 %, . ve : a 
personnel. “Stated simply, the issue is not an issue. i 


- Proof of Concept Assessment 


. & 
An objective assessment of proof of concept of the USMES curriculum was 


2 


oe "e 
limited by the primitive stat@ of the art of measuring problem solving abil- 


‘ities in elementary school children. As the evaluation team pursucd a two- 


fold thrust of program evaluation and new instrument’ development, we applied 
‘ 


“the most satisfactory existing measures ‘of pfoblem solving to answer immedi- 9 


ate needs shared by the developers and the funding agency about the progress 
, . 1 


of USMES students in real, complex problem solving. 


Thése ‘measures were the Playground Problem and the Picnic Problem. The 


€ . 


conceptual bases for these simulated, real-life-relevant problem tasks re- 
flected John Dewey's conceptualization of the problem solving process, whose 
"five logically distinct steps" permeate much of the literature about USMES 


prepared by the USMES Central Staff. 


- e 


_ Designed as parallel forms of one another, bgth problem tests are accom- 
panied by manuals for trained administrators' presentation of the tests to 


. groups of five children. . 


SN 
4 


The "scoring protocols developed for the tests offer both cognitive and 
; Pa 
affective assessments.’ The cognitive scores provide indices of the students! 


{ 


| 
abilities to identify, measure, calctilate, and record data on factors which 


they think are salient to the solution of the as The behavioral jas- 


} 
‘ | 


: segssments an ratings on motivafion to accept the problem, commitment to 
a. a es 


{ 
FT ' 


task, efficiency of manpower, and the nature of group leadership. Additionally, 


, 


' “the protocol for the Playground Problem afforded an assessment of the students! 


: . | 


ioe a : 


*6 


ry 


products. their drawing of the play area design. 

\Netther the Playground Problem nor the Picnic Problem satisfied the 
program developers‘ concerns that Rhee tests meet all of their criteria 
for "realness." Therefore, rigorous Anvestigation of these tests! relia- 
bility and seativereal validity did not seem to be warranted. Content vali- 
dation of the tests as simulated measures ‘of life-like,. complex problem 


solving was established. F 


No differences between, USMES “aiid control students were noted in the be- 


5 - ® 


~ havioral aspects of their work on the problems. The four cognitive scores 
ws. ao zs 


were subjected to repeated measures analyses of variance and bo analyses of 
covariance. Consistently, significant differences among grade levels were 
observed for all four cognitive aspects of the SRE Te perteciaies As one 
might expect, the older students in both treatment groups outperformed the 

: Saar é 
younger students. They identified more factors and progressed to more fre- 
quent, higher level measuring, calculating, ana Sebordive on these factors. 


However, no significant differences between treatment groups were found on 


any of the ratings derived from the scoring protocol. 


. 


' Attitude Changes in USMES and Control Students 


Having analyzed the cognitive effects of the USMES ogram, on its stu- 
dents, the evaluation team then truned its asin on-the affective dimension. 
What is bie impact of USMES on the students' attitudes? 

An attitude scale was developed and pilot tested Ly the evaluation team 


especially for this-USMES evaluation. The scale consisted of two parts. 


. Part I contained items designed -to measure attitudes toward math and science 


° 


and toward various teaching strategies and learning activities which are em- 


bodied im the USMES approach. Part II began with a statement of a real-life, 


-13-- 


complex problem facing a group of engincers, and then followed with a series 


of itéins. 


a. 


, Factor analyses of the largest data base, the post-test attitude results 
for 1491 students, yielded 7 factors on Part I and 4 factors on Part Il. —The 
repeated measures analyses revealed highly significant (p .g +0001) pre-to- 


post test administration differences for most of the I'l factors. Only the 
| 


academic insecurity.scale from Part II produced no significant pre- post-test 
| 


differefces. é 


However, these pre-to-post differences may be indicative only of "time- 
of-year'! effects, as discussed by Ahlgren.. This evaluation did employ a con- 
trol group device but fall-fall testings, were not feasible because samples 
would not have been accessible the second fall. There were no treatment by 
test sduinieteatiah toteriebions resulting from our analyses. Both treatment 
groups moved in the same direction. But in light of Ahlgren's and his asso- 
ciates' observations, our results are very interesting because on Hest of 
the scales, the groups attitudes moved toward the more socially or academical- 


ly desirable direction, up or down, over the course of the school year. 


The time-of-year effect observed by Ahlgren etal. is probably evidenced 


in the, overall decline of students' scores on factor 4, Group Learning, and 


on factor 6, Salf-pirected Learning, over the period from Fall to: Spring. 
At the end of the school year, students, perhaps, are tired or less motivated, 
and would prefer to nlag a more passive role in learning, as the teacher 
"runs the show." —_ 
While there were no significant treatment differences revealed by repeated 


measures analyses, there were a number of significant grade differences in, 
wv . 2 


attitude factors which have implications for LSMES development and USMES usage, 
‘ 


16 


v 


’ even though the grade ,differences did not interact with treatment when co-' . 


variance adjustments were made. Guidelines fur curriculum development and 


implementation which come from research in developmental psychology are _re- 


inforced by some of the grade differences observed in thts affective evalu- 


-atione - . 


/ 


Students in the upper grades expressed a greater preference for self- 


Q 


direéted learning activities, were less concerned with pleasing the teacher wg 


- ‘ ; 
iS and consenting to the answer held ty the class, and were less inclined to 


believe that only one solution is best for a complex problem. 


“sh - « a, r 


The students we tested, both USMES and control, were very positive in 


. 


their attitudes toward arithmetic. They enjoyed it very much, and this en- 


e : joyment increased over the school year and perhaps further over grade levels. 


“Statements about increased enjoyment in higher grades must be tenuous because 


the research was cross sectional and not longitudinal. 
The factor Structure emerging From tie factor analysis of our scale sug- 


gested that students could distinguish between the attributes gf enjoyment 


( and value with respect to arithmetic. Not only did the sundents in our sam- 
ple enjoy arithmetic very much, they also valued it highly, and their aver- 
age ascription of value to arithmetic was. hightened almost to Limit af our 

. measurement scale on the post-test. 


> These expressions of positive regard for drithmetic were corroborated, 
— 


‘ ’ 


in part, by the results of our interviews with 120 USMES children. When asked 


what they had done in school that year that they particularly enjoyed, approx- 


imately half of the student interviewers responded "math!" or "arithmetic!" 


without prompting. 


a aan Res a. 


. The descriptive statistics summarizing the treatment groups’ pre- and 


post-test positions, at each grade level, on the scale of*science appreci- - 


2 


“ation « were also noLeverEhys For all categories, initially positive expres- 


-~ _ sions of Bales appreciation became more positive over the course of the 


e 
. 


Bt SR oa School year. This result may be indicative of a slowing-down or a reversal 


in the trend of older student! gergratly negative attitudes toward science 


-..and scientists which was observed in the 1950's (Heath, Maier, Remrers, & 


= ee 2 


hae Rogers, 1957). Almost.two decades of intensive ‘scence curriculum devel op- 


‘ment activity have followed. Many studies of the cognitive outcomes of new ; ‘i 


e 
’ 


methods of science instruction have appeared since 1957. However, it is 


difficult to obtain a picture of the effects of ‘these curricula onthe devel- 


» ~ 2 \ 
opment of affective behaviors of students; the cognitive studies proliferate, 


but the research on affective responses to science curricula is dispropoér- 


tionately smaller (Kahn & Weiss, 1973, p. 784). : 
-Only one treatment difference closely approached statistical significance, 
. oe : od 
but that difference may have special practical significance: USMES students 


tended to express greater appreciation for science than did control students. 


® 


Recommendation for_a Future Study 


° 


Considerable information was volunteered to the-senior evaluators by tea- 


chers and administrators at almost.all of the USMES sites on a singular theme. 
, ; > 


In effect, the "feedback" indicated a serious morale problein growing among 
F. 


the implementation and developmental teachers.and: their sponsoring principals, 


i : 
threatening a possible movement to disengage from the program. The evalua+ 


: tors were not charged with the investigation of this issue, nor did they have 


« 


the necessary instruments to document of "objectivize'' its content. /However, 


because of the serious possible implications of this issue for the future 


i 
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dissemination of the USMES program, a recommendation for its future inves- 
<b 


tigation and rectification was advanced. 


Conclusion 


“4 


In sum, this evaluation documents the.decided perceptions of the USMES 


~-” 


teachers that the USMES program does teach problem solving skills to its 
students, while the more objective instruments to measure problem solving 


skills are still too unsophisticated to give an accurate reading of this 


‘same question. Basic skills of USMES students, according to both- teacher 


perceptions and objective tests. have not suffered. . Additionally, results 
from the interviews with teachers and students documented the "excitement" 
for learning selfainttiation and social interaction skills acquired by stu- 
dents in USMES classes. In their work on real problems, USMES students 


sensed that their efforts can make a difference. : 


